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Abstract 

The paper concerns with the infinite dimensional Hamilton-Jacobi- 
BeUman equation related to optimal control problem regulated by a linear 
transport equation with boundary control. A suitable viscosity solution 
approach is needed in view of the presence of the unbounded control- 
related term in the state equation in Hilbert setting. An existence-and- 
uniqueness result is obtained. 
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Introduction 

We study the Hamilton- Jacobi-Bellman equation (from now HJB equation) re- 
lated to the infinite dimensional formulation of an optimal control problem 
whose state equation is a PDE of transport type. 
We consider the PDE 

■§^x{s, r) + f}^x{s, r) -^x{s, r) + a(s, r) (s, r) E (0, +oo) x (0, s) 
x(s,0) = a{s) if s>0 (1) 
x{0,r) = x°{r) if r e [0,s] 

where s, /9 are positive constants, /i G M, the initial data x'^ is in L^(0,s) and 
we consider two controls: a boundary control a is in Lf^^{[0,+oo);R) and a 
distributed control a S Lf^cd^^ +oo) x [0, s];R). More precisely we will consider 
controls such that a{-) E £ and a(-) e A where £ and A will be defined in 
Section n We write "—/ix" instead of "/xa;" because it is the standard way to 
write the equation in the economic literature where —fi has the meaning of a 
depreciation factor (and only the case fi> is used). Here we consider a generic 
/X G M. 
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Using the approach and the references described in Section ^ the above 
equation can be written as an ordinary differential equation in the Hilbert space 
n = L^{0,s) as follows 

-^^x{s) = Ax(s) - nx{s) + a(s) + /3(5oa(s) /r,N 
x(Q) = x° ^ ' 

where A is the generator of a suitable Co semigroup and is the Dirac delta in 
0. Such an unbounded contribution in the Hilbert formulation comes from the 
presence in the PDE of a boundary control (see (BDPDM92) ). We consider the 
problem of minimizing the cost functional 

/•oo 

J{x,a{-),a{-)) ^ e-P'L{x{s),a{s),a{s))ds (3) 
Jo 

where p > and L is globally bounded and satisfies some Lipschitz-type condi- 
tion, as better described in Section ^ The HJB equation related to the control 
problem with state equation ^ and target functional Q is 

pu{x) - {\7u{x), Ax) - (Vu, ~nx) ^2(o,j) - 



inf 

(Q,a)esxr 



((/3(5o(Vu), a)g + (Vu, 0)^2(0^,-) + L{x, a, a)) = 0. (4) 



The sets F and S will be introduced in Section^ If we define the value function 
of the control problem as 

V(x)'^^^ inf J{x,a{-),a{-)), 

(a(-),a(-))G£x^ 

we wish to prove that it is the only solution, in a suitable sense, of the HJB 
equation. 

We use the viscosity approach. Our main problem is to write a suitable 
definition of viscosity solution, so that an existence and uniqueness theorem 
can be derived for such a solution. The main difficulties we encounter, with 
respect to the existing literature, is in dealing with the boundary term and the 
non-analyticity of the semigroup. We substantially follow the original idea of 
Crandall and Lions f lULQOI and |CL91| ) - with some changes, as the reader 
will rate in Definition II . 1 41 and Definition 1 1.1 51 - of writing test functions as the 
sum of a "good part" , a regular function with differential in D{A*) and a "bad 
part" represented by some radial function. The main problems arise from the 
evaluation of the boundary term on the radial part. 

In order to write a working definition in our case some further requirements 
are needed, like a regularity of the test functions, the presence of a "remain- 
der term" in the definition of sub/super solution and the i?-Lipschitz continuity 
(see Definition II. l()|l of the solution. This last feature guarantees that the max- 
ima and the minima in the definition of sub/super solution remain in D{A*) (see 
ProDOsition l3.1|l . Some other comments on the definition of solution (Definition 
11.141 and ll.l5|) need some technical details and can be found in Remark 1 1.1 71 

The used technique cannot be easily extended to treat a general non-linear 
problem because we use the explicit form of the PDE that we give in More- 
over the (linear) case in which is not a constant but a function of L°°(0, s) 
(and so we have /i(r) in equation |^) presents some difficulties in the proof of 
the uniqueness theorem and so it is not an easy generalization of the present 
work. See Remark 13.81 for details. 



2 



A brief summary of the literature Hamilton-Jacobi equations in infinite 
dimensions, especially when arising from optimal control problems in Hilbcrt 
spaces, was first studied by Barbu and Da Prato f ,BDP83) . ,BDPP83: ,) with 
strong solutions approach. The viscosity method, introduced in the study of 
finite dimensional HJ equations in |CL83| was generalized by the same authors 
in a series of works; the most important for our approach are |CL90j and |CL91| . 
Moreover new variants of the notion of viscosity solution for HJB equations in 
Hilbert space was given in Tshgl, |Tat92b| . |TatH4| . |'l'at92a| and P^M] , 

The study of viscosity solution for HJB equations in Hilbert spaces aris- 
ing from optimal control problem of systems modeled by PDE with boundary 
control term is more recent. In this research field there is not an organic and 
complete theory but some works on specific PDE that adapt the ideas and 
the techniques of viscosity solutions to particular problems using their own 
characteristics like we do in this work for the problem regulated by transport 
equation. For the first order HJB equations see jCGS93j . jCT96c| ( see also 
|CT96al fCTgObp where some classes of parabolic equations are treat, |GSS02| 
in which the authors study the HJB equation related to a two-dimensional 
Navier-Stokes (see also |Shi02| '). It must be noted that all these works treat the 
case of A analytic. 

HJB equation like Q was treated, only in the convex case, with strong 
solutions approach adapting the Barbu and Da Prato' arguments in |Fag02| 
and |Fag05a| . 

A motivating economic problem Tranport equations are used to model 
a large variety of phenomena, from age-structured population models (see for 
instance Ian95, AniOO, IMMOS] ) to population economics ( FPV04 ), from epi- 
demiologic studies to socio-economic science and transport phenomena in phisics. 

Problems such as can be used to describe, in economics, capital accu- 
mulation processes where an heterogeneous capital is involved, and this is the 
reason why the study of infinite dimensional control problem is of growing in- 
terest in the economic fields. For instance in the vintage capital models x{t, s) 
may be regarded as the stock of capital goods differentiated with respect the 
time t and the vintage s. Heterogeneous capital, both in finite and infinite di- 
mensional approach, is used to study depreciation and obsolescence of physical 
capital, geographical difference in growth, innovation and R&D. 

Regarding problems modeled by a transport equation where an infinite di- 
mensional setting is used we cite the following papers: |B(t98| and jBCxflll 
on optimal technology adoption in a vintage capital context (in the case of 
quadratic cost functional), [HKVFO.I] on capital accumulation, |BG99j on opti- 
mal advertising and |Fag05a| |Fag05b| that studies the convex functional case 
using a strong solutions approach. See also |FG04| . 

Moreover, we mention that the infinite dimensional approach may apply to 
problems such as issuance of public debt (see |AAB"'"04j for a description of 
the problem). In that problem a stochastic setting and simple state-control 
constraints appear, but hopefully the present work can be a first step in this 
direction. 

Plan of the paper The work is organized as follows: in the first section 
we remind some results on the state equation, we introduce some preliminary 
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remarks on the main operators involved in the problem, we explain some nota- 
tions, we define the HJB equation and we give the definition of solution. The 
second section regards some properties of the value function (in particular some 
regularity properties) that we will be used in the third section to prove that it 
is the only (viscosity) solution of the HJB equation. 

Acknowledgements The author would like to thank Prof. Andrzej Swi§ch 
for his hospitality, his great kindness, for many useful suggestions and stimulat- 
ing conversations. 



1 Notation and preliminary results 
1.1 State equation 

In this subsection we will see some properties of the state equation: we write it 
in three different (and equivalent) forms that point out different properties of 
the solution. We will use all the three forms in the following proofs. 
We consider the PDE on [0, -f oo) x [0, s] given by 

■§^x{s, r) + /3^x(s, r) = -^a;(s, r) + a(s, r) (s, r) e (0, +oo) x (0, s) 
x{s,0) = a{s) if s>0 (5) 
x{0,r) = x°{r) if r e [0, s] 

Given an initial datum G i^((0, s); M) (from now simply L^(0, s)), a boundary 
control a(-) g Lf^^{[0, +oo);R) and a distributed control «(•) € Lf^^{[0, +oo) x 
[0, s];M.) the Q has a unique solution in Lf^^{[0, +oo) x [0, s]; M) given by 

, , i e~'''x°{r-(3s)+ f'e-f^a{s-T,r-l3T)dT re[(]s.s] 



In the following a;(s,r) will denote (O- 

We can rewrite such equation in a suitable Hilbert space setting. We take 

the Hilbert space L^{0, s) and the Co semigroup T{t) given by 

[s)nr\ - I Q forr€ [0,(3s) 

The generator of T{s) is the operator A given by 

D{A) = {f eH^[0,s] : /(0) = 0} 
A{f)[r]^-/3£f{r) 

(see IBCtOII for a proof in the case /3 = 1, the proof in our case can be obtined 
simply taking s' — (3s). 



Remark 1.1. To avoid confusion if x ^ L^{0,s) we will use [■] to denote the 
pointwise evaluation, so x[r] is the value of x in r € [0, s]. On other hand x{s) 
will denote the evolution of the solution of the state equation (in the Hilbert 
space) at time s (as in That is, x{s) is an element of H while x[r] is a 

real number. 
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We want to write an infinite dimensional formulation of jSJ but in L^{0,s) 
it should appear like 

j^x{s) = Ax{s) - ^ix{s) + a{s) + f3Soa{s) , , 

a;(0)=a;0 ^' 

where a{s) € L^{Q,s) is the function r i— s- a{s,r). Such expression does not 
make sense in L^(0, s) for the presence of the unbounded term f3SQa{s). We can 
anyway apply formally the variation of constants method to ^ and obtain a 
mild form of ^ that is continuous : [0, +00) L^{0, s). This is what we do in 
the next definition. Note that we have written (0) only to be more clear but we 
could go on in a more formal way without it. 

Definition 1.2. Given x" e L^{0,s), a(-) e i^^^([0, +00); R) and 
a(-) e L;^o^([0, +00); L^(0, s)) the function in C([0, +00); L^(0, s)) given by 



x{s) = e-f"'T{s)x° - A I e-''("-^)T(s - r)(a(T)iy)dr+ 

+ / e-^(''-^)T(s-T)a(T)dr (8) 







where 



v. [0,s] 
v. r ^ 



is called mild solution of 

Remark 1.3. We could include the term ~^x in the generator of the semigroup 
A taking a A ~ A — ^il. In this case the equation ^ would appear in the 
following equivalent form: 

-^x(s) = Ax(s) + a(s) + (3Soa(s) (9) 
as 

The problem of this approach is that often we will use, in the estimates, the 
dissipativity of the generator and A is dissipative only if pL > 0. Nevertheless 
we wrote the mild form 0) as if we consider the ( of course equivalent! ) state 
equation indeed in the definition we consider for example the convolution 
term given by 

e~i'^'-^'>T{s~T)a{T)dT 



and e^^''*-'T(s) is exactly the semigroup generate by A. In the sequel (see i4^[ l) 
we will use also another mild form of the state equation that is not explicit and 
it is the one obtined if we do not include the term e"'"' in the semigroup. The 
two forms are equivalent. 

Proposition 1.4. Taken x{s) the function : R+ — > L^{0,s) given by 0) and 
x{s,r) the function : x [0, s] — s- R given by 0) we have x{s)[r] = x{s,r). 

Proof See |H(4m| . □ 
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Eventually we observe that ^ can be rewritten in a precise way in a larger 
space where we have not problem with the (3So term. The mild solution will be 
the only solution (in a suitable sense) of the new differential equation. We need 
more notation to write it. 

We consider the adjoint operator A*. Its explicit expression is given by 

f DiA*)'^^ {f eHHO,s) : /(s) = 0} 
1 A*{f)[r]^P^J{r) 

On D{A*) we put the graph norm and the related Hilbert structure. We consider 
the inclusion 

i: D{A*) ^ L^{0,s) 

and its continuous adjoint 

i*: L^{0,s) D{A*y 

where we have identified with its dual. 

We can extend A to a generator of a Cq semigroup on D{A*y (the domain 
of the extension will contain L^) and we observe that the Dirac's measure 60 G 
D{A*y (see |Fag02| Proposition 4.5 page 60 for details). 

Proposition 1.5. Given T > 0, x° e L^{0,s), a(-) G L^{0,T), a(-) G L^{[0,T]; L^{0,s)), 
13) is the unique solution of 



^i*x{s) — Ax{s) — fix{s) + a{s) + /3(5oa(s) 
x(0) = .tO 



(10) 



in M^i'2(0,T;D(A*)') n C(0,T,H). Moreover if a{-) G W^^^iO,T) then such 
solution will belong to C^{0,T; D{A*y) n C{0,T;n). 

Proof See |BDPDM92j Chapter 3.2 (in particular Theorem 3.1 page 173). □ 
1.2 The definition of the operator B 

In this subsection we give the definition of the operator B that will have a 
fundamental role. We could use an abstract approach, noting that A and A* 
are both generator of Cq semigroups of contractions and then both are negative 
(see jDPZ92j page 424) and the set {A G C : Re (A) > 0} is in the resolvent 
of both A and A* (Hille-Yosida theorem, see jLY95j page 53). Anyway in this 
case we can also follow a more direct approach that allows to find the explicit 
form of the operator. 

To note that that A* and A are negative operators we take G D{A*) (so 
<t>{s) = 0) 

(A*0,(/.) = f P<t>'{r)4>{r)dr = 







and for cj) G D{A) (so 0(0) = 0) 



= / -I3(l)'{r)(t){r)dr 







2 



6 



So, given a A > 0, the operators {A — XT) and {A* — AI) are strongly negative: 
{{A - XT)x,x) < -X\x\j^ for all x G D{A) and {{A* - XT)x,x) < -X\x\j^ for all 
X e D{A*). 

We can also directly prove that 

(A ~ XI)-^ : n D{A) 

is a continuous negative linear operator whose explicit expression is given by 

{A - AI)-i(0)[r] = i (^-e-F'- e^0(r)dr^ 

The continuity can be proven directly with not difficult estimates and the neg- 
ativity can be proven directly using an integration by part argument. 
In the same way we can prove that 

{A* ~ Xl)-^:n~^ D{A*) 

is a continuous and negative linear operator and that and its explicit expression 
is given by 

iA*-Xl)-\m = i (^-e^'-£e-^0(r)dr) 

Eventually we can define B {A* - Xl)-^{A~ Xl)-^ ^ {{A- Xl)-^)* (A- Xl)-^ 
that is continuous, positive and selfadjoint^. Moreover 

{A* - Xl)B ^{A- Xl)-^ < 

and so 

A*B = {A- XT)-^ + XB <XB 
if we choose A < 1 we have that A*B is bounded and 

A*B < B (11) 

Thus B satisfies all requirements of the "weak case" of |CL90| . 

Remark 1.6. Note that B^/"^ is a particular case of the operator that Renardy 
found in more generality in ]Ren9&l and so B^^^ : Ti — > D(A*) continuously and 
m particular 'R{B^/'^) C D{A*). 

Notation 1.7. For every x Ti. we will indicate with \x\b the B-norm that is 
^ {Bx, x)j^. We will write Tis for the completion ofTL on the B-norm. 

Remark 1.8. Thanks to the definition of A* the graph norm on D{A*) is 
equivalent to the H^(0,s) norm. In particular D{A*) is the the completion of 

K = {/|[o,5] : / e with suppif) C (-(X3,s)} 

with respect the H^{0,s) norm. So, since H^(0,s) ^ C([0, s];R), we can calcu- 
late P6o on the elements of D{A*). 

^See IYos95| Proposition 2 page 273 for a proof of the equality (A* -AI)"! = ((A-AI)"!)*. 
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Notation 1.9. In some cases the notation {x,y) may be not clear, so when 
necessary we will use an index to avoid confusion: if H is a Hilbert space (for 
example H — H = L'^{0,s) or H = H^{0,s) or D{A*) ...) the notation {x , y) ^ 
will indicate the inner product in the Hilbert space H . Otherwise if Z is an 
Banach space (possibly an Hilbert space) and Z' its dual the notation {x,y)2,xZ' 
will indicate the duality. In a few words, a single index means inner product, a 
double one indicates duality. 

When there is no index it is because we have omitted the index Ti = i^(0, s). 



1.3 The control problem and the HJB equation 

In this subsection we describe the optimal control problem, state the hypotheses, 
define the HJB equation of the system and give a suitable definition of solution 
of the HJB equation. 

We will consider the optimal control problem governed by the state equation 

-§^i*x{s) = Ax{s) - fix{s) + a{s) + /3(5oa(s) 
xif)) = X 

that has a unique solution in the sense described in Section 11.11 Given two 
compact subsets F and A of M we consider the set of admissible boundary 
controls given by 

def 

A — {a: [0, +oo) ^ r C R : a(-) is measurable} . 
Moreover we call 

E =^ {7: [0,s] ^ ACM : 7(.)ei2(0,s)}. 

In view of the compactness of A we have that E C L^{Q, s). We define the set 
of admissible distributed controls as 

£ {a: [0, +00) ^ E C L^(0, s) : q;(-) is measurable"} 

In view of the complactness of F and A ^ C Lf^^{[0, +oo);R) andf C L^^^([0, +oo)x 

[0,s-];M). WecahllFll snp^^M, ||A|| =^ sup^g^dH) and ||S|1 =^ sup„gs(l«k=L^(o,s-)) 
(they are bounded thanks to the boundedness of F and A). 

We will call admissible control a couple (a(-),a(-)) G £ x A. The cost 
functional will be of the form 

J{x,a{-),a{-)) = / e^P''L{x{s),a{s),a{s))ds 
Jo 

where L is uniformly continuous and satisfies the following conditions; there 
exists a Cl > with 

(LI) \L{x,a,a) ~ L{y,a,a)\ < Cl {B{x -y),{x- y))^xw^("'«) e E x F 
(L2) \L\ <Cl< +00 

We define formally the HJB equation of the system as 

pu{x) - {S/u{x), Ax) - {S/u{x),-nx) - H{x, \7u{x)) = (HJB) 
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where H is the HamUtonian of the system and is defined as: 



j H:Hx D{A*) R 

\ H{x,p) mi(^a,a)esxr {{PSQ{p),a)^ + {p,a)^ +L{x,a,a)) 

(according to Notation II. 91 (■. •)^ is the usual real product). 

Before we can introduce a suitable definition of (viscosity) solution of the 
HJB equation we have to give some preliminary definitions. 

Definition 1.10. v G C{TC} is Lipschitz with respect the B-norm or B-Lipschitz 

if there exists a constant C such that \v{x) ~ v{y)\ < C\{x — y)\B C\B^/'^(x — 
y)\'H for every choice of x and y inJi. In the same way we can give the definition 
of locally B-Lipschitz function. 

Definition 1.11. A function v G C{Ti.) is said to be B-continuous at a point 
X (z Ti if for every Xn € Ti. with x„ x and \B{xn — x)\ —* 0, it holds that 
^{xn) v{x). In the same way we can define the B -upper/lower semicontinuity. 

Definition 1.12. We say that a function cj) such that G C^{TC) and (p is B- 
lower semicontinuous is a test function of type 1 and we will write (j) S testl if 
V0(x) e D{A*) for all X Cz Ti. and A*'V(j): TL ^ TL is continuous. 

Definition 1.13. We say that g G C^(7i) is a test function of type 2 and we will 
write g G test2 if g{x) ~ god^^l) for some function go : M+ — )■ R nondecreasing. 

Definition 1.14. u e Cili.) hounded and Lipschitz with respect the B-norm 
is a subsolution of the HJB equation (or simply a "subsolution") if for every 
(j) € testl and g € test2 and a local maximum point x of u — {(p -\- g) we have 

pu{x) - (A*V(/)(x), x) - (V(/>(a;) + V.g(a;), -~^lx) - 



inf 

(a,a)eSxr 



( {[35o{V(t){x), a)jj. + {V(t){x) + Vg{x), a)^ + L{x, a, a)) < 



Definition 1.15. v S C(7i) hounded and Lipschitz with respect the B-norm is 
a supersolution of the HJB equation (or simply a " super solution" ) if for every 
(j) € testl and g € test2 and a local minimum point x of v + {(j) -\- g) we have 

pv{x) + {A*\7(f){x),x) + (V(/)(x) + Vg(a;), ~^lx) - 



inf 

(a,a)eSxr 



( - (/3<5o(V0(a;), a)^ - {Vcb{x) + Vgix), a)„ + L{x, a, a)) > 



Definition 1.16. v G CiTL) hounded and Lipschitz with respect the B-norm is 
a solution of the HJB equation if it is at the same time a supersolution and a 
subsolution. 

We write now some remarks on the definition we have just given, to explain 
its meaning: 
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Remark 1.17. In the definition of viscosity solution we have used two kinds 
of test function: the testl and test2 that, as usual in the literature, play a 
different role in the definition. In view of their properties and their regularity 
the functions of the first set (testl) represent the "good part" while the main 
difficulties come from the function of the set test2 that have the role of localize 
the problem. 

A difficulty of our case is the following: the trajectory is not Lipschitz in the 
norm of the Hilbert space Ti. and so, given a function g € test2, the term 

(where x{s) is a trajectory starting from x) cannot be treated with standard 
arguments. The idea is to consider only B -Lipschitz solution so that the maxima 
considered in Definition \1.14\ and Definition \l.l^ are in D(A*). If the "starting 
point" X is in the domain of D{A*) there are some advantages in the estimate 
of but some problems remain: in such case we will prove in Proposition \3.4\ 
that (if a{-) is continuous) 



(v.,M. + . (0)) 



<£i(H),me,o(.) 

\x\ 2 

where the rest O is uniform in the control. So the "worse case" is the one 
described in the definition. 



2 The value function and its properties 

The value function is, as usual, the candidate to be the unique solution of the 
HJB equation. In this section we define the value function of the problem and 
then we verify that it has the regularity properties required to be a solution. 
Namely we will check that it is i?-Lipschitz ('Proposition 12 .4|l . To obtain such 
result we need to prove an approximation result fProposition l2.l'|l and then a 
suitable estimate for the solution of the state equation (Proposition [^J. 
The value function of our problem is defined as: 

V^x)"^ inf J{x,a{-),a{-)) 
We consider the functions 

f 77„ : [0, s] ^ M 

1 Vni'T) [2n — 2n'^r]~^ 

(where [•]"'" is the positive part). We then define 

Such functions are linear and continuous and their adjoints are 
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C* "approximate the delta measure" . The approximating equations we consider 
are 



g^x„(s) = Ax„{s) - ^j.Xn{s) + a{s) + PC*a{s) 
x„(0) = X 



(17) 



In the proofs we wiU use the mild solutions of the original and the approximating 
state equations. The first was introduced in ((SJ, the second can be found in 
f |Paz83| page 105 equation (2.3), we include the term e^^^ in the semigroup): 



x{s) = e-^^'e'^^x + / e-^'-^^''e^'-^'>'^a{T)dT- 

-A ^\-^'-^^^'e^'-^^^{a{T)ly)dT (18) 



Xnis) = e-f''e''^x+ / e-(^"^)^e(^^^)'^a(r)d 



T+ 



+ 



-(«-^)fe(^-^)^/3C*a(T)dT (19) 



Proposition 2.1. For T > and (a(-), a(-)) ^ £ x A 



lim sup \xn{s) — x{s)\t-i — 
se[o,T] 



Proof. Using the mild expressions we find 

\x{s) - Xn{s)\ -- 



A I e"("-^)^e(^-^)^(a(T)i.)dr- 

e-(«-^)Me(^-^)^/3Q(a(r))dT 



(20) 



To estimate such expression we will use the explicit expression of the two terms 
(as two-variable function). We simplify the notation (only in this proof!) taking 
an "extension" of a(-) to the whole M obtained by putting a(-) identically on 
So 

y(s,r) (^-^J^ e-(''~^)^e(''-^)^(a(T)i^)dT^ [r] ^ e-'^''a{s - r/f3) 



yn{s,r) 



def 



e-(«— )/'e(«— )^/JC*(a(r))dTj [r] = 

.■A(l/n) 



s d9 (21) 



Now for all s G [0, T] 

|y(s,-) -yn(s,-)lw=L2(o^j) 



< 



< 



^"0(5 - r//3) - j'^ e-T^^''-''\2n - 2n''e]+a (^-j^ + ^ . 



l/n 



dr 1 < 
(22) 
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(for s<T) 



i/n ^ \ 



(23) 



Such estimate does not depends on s, the integral term goes to zero because it 
is the convolution of a function in L^(0, T) with an approximate unit and the 
second goes to zero for n ^ oo. □ 

Proposition 2.2. Let (jj e C^iU) he such that Vcj): H ^ D{A*) (D{A*) is 
endowed, as usual, with the graph norm) is continuous. Then, for an admissible 
control (a{-),a{-)), if we call x(-) the trajectory starting from x and subject to 
the control (q;(-), a(-)), we have that, for every s > 0, 



<j>{x{s)) = cj){x) + / [{A*^,P{x{t)),x{t)) + (/3<5o(V0(a;(T))), a(T))K + 

+ (V0(a;(T)), a(r)) + {V <j,{x{T)) , ^ ^ix{t))] dr (24) 

Proof. In the approximating state equation (|17(l the unbounded term I35q does 
not appear (/3C* are continuous) and then (see LY95 Proposition 5.5 page 67) 
for every </>(•) e C^{n) such that A*V4>{-) G C{n) we have 



4>{xn{s)) = <i,{x) + / [(A*V</)(a;„(T)), a:„(T)) + (V</)(a;„(r)), /?CXr)) + 
Jo 

+ (V(/)(a;„(T)), a(T)) + (V0(x„(t)), -[ix.n{T))\ dr. (25) 

In view of the continuity of the operator C* we can pass to its adjoint (see 
for an explicit form of the operator C„) and we obtain: 



0(x„(s)) = (i>(x) + / [(^*V0(a;„(r)), x^(t)) + (/3C„V0(a;„(r)), air)) + 

+ (V0(a;„(T)), a(T)) + (V0(x„(r)) (T))]dr. (26) 

Now we prove that every integral term of the H26(l converges to the correspond- 
ing term of the (|24|l . This fact, toghether with the pointwise convergence of 
{(f>{xn{s)) "^°°> 0(a;(s)) due to Proposition l2.1|l prove the claim. 

First we note that, in view of Proposition 12.11 and of the continuity of x, 
a;„(r) is bounded uniformly in n and r e [0, s] and, in view of the continuity of 
V(/), V(/)(a;„(r)) is bounded uniformly in n and r e [0, s] So we can apply the 
Lebesgue theorem (the pointwise convergence is given by Proposition 12.11 and 
|a(T)| < ||S||) and we prove that 

[(V</)(x„(t)), «(t)) + (V</)(x„(t)), -fiXnir))] dr 



[{V4>{xiT)),a{T)) + (V</)(x(t)), -/ix(T))] dr (27) 
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Now we observe that, in view of the continuity of A* V(/) and of the of Proposition 
12.11 the term A*V(/)(x„(t)) is bounded uniformly in n and r £ [0, s] so the same 
is true for 

\A*V^ixnir))~A*V^{x{T))\. 

Therefore we can use the Lebesgue theorem (the pointwise convergence is given 
by Proposition 12.1(1 to conclude that 



{A*V(f){x{T)),x{T)) dr 



(A*V0(a;„(T)),x„(T)) dr 
We have now to prove that 

(/3C„V0(a:„(r)),a(r)) dr ^ 



{(3So{V4'{x{T))),a{T))j,dT (28) 



We first note that C„ 
z S H^{Q, s) we have 



Sq in H ^(0, s) and then in D(A*y. Indeed given 



|(C„ - Sq)z\ 



z[r]?7„[r]dr - z[0] 

■l/ri 



z[0]+ / a^z[r]dr U„[r]dr-z[0] 



(29) 



(di^z is the weak derivative of z) integrating by part 



z[0] 



d^z[r]dr 



Vn [r]dr 

l/n 



77„[r]drdr - z[0] 



writing ijn in explicit form and making calculi (note that Jq^" 77,1 [r]dr = 1) 



< (30) 



< 



Xlos/n] [r]|5c^z[r]|dr 



< 



^\\4m{o.s) 

Summarizing: by Proposition 12.11 x^J-) ~ — ^ x(-) in C{[0,T];TC), then (by 
hypothesis on cj)) V0(a;„(-)) "^°°> V(?!)(a;(-)) in C{[0,T]; D{A*)) and then, by the 
last estimate /?C„(V0(a;„(-))) /3(5o(V<?!)(a:(-))) in C([0,r];R). Then ^ 

follows by Cauchy-Schwartz inequality (it is the scalar product in L^(0, s)). □ 

Proposition 2.3. Given T > and a control (a{-),a{-)) E £ x A there exists 
ct such that for every x,y gH 

sup \xx{s) - Xy{s)\% < ct\x - y\%, 
se[o,T] 

where Xy{-) is the solution of 

^i*x{s) = Ax{s) + a{s) - fj.x{s) + (3Soa{s) 
xiO) = y 



and Xx{-) the solution with initial data x 
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Proof. We use Proposition 12.21 with 4){x) = {Bx,x). So V0(x) = 2Bx. We 
observe that Xx{-) — Xy{-) satisfies the equation 

-^i*ixx{s) - Xy{s)) = A{x^{s) - Xy{s)) - ^J,{xxis) - Xy{s)) 
{xx - Xy){0) = X - y 

(the one of Proposition 12 . 21 with control identically 0) and then by 



\x^{s) - Xy{s)\B ^\x~y\B + 2 / {A*B{x^{r) - Xy{r)), {x^{r) - Xy{r))) - 

Jo 

- fi {B{xx{s) ~ Xy{s)),Xx{s) - Xy{s)) dr < (31) 

< la; - y\l + 2(1 + / (B(x,(r) - x,(r)), (xAr) - Xyir))) dr 
Jo 

now we can use the Gronwall's lemma and obtain the claim. □ 

Proposition 2.4. Let L satisfy (LI) and (L2). Then the value function V is 
Lipschitz with respect the B-norm 

Proof. Assume V{y) > V{x). Then we take (a(-),a(-)) £ £ x A a.u £-optimal 
control for x. We have: 

/•OO 

\V{y) - V{x)\ -e< e~f"\L{xy{s), a{s),a{s)) - L{x^{s), a{s) , a{s))\ds = 
Jo 

If we look the explicit for of Xx{-) and Xy(-) as two- variables functions we see 
that they depend on the initial data only for s S [0, After this period they 
depends only on the control. So for s > ^ Xx{s) = Xy{s) and so the previous 
integral is equal to 

s/l3 

e~'''*^\L{xy{s),a{s), a{s)) - L{xx{s), , q;(s), o(s))|ds < 



(by (LI) and ProDOsition l2.3(l 

< / e~''^CL\xy{s) - Xj:(s)\Bds <sCsCl\x - y\B 
Jo 

Letting £ ^ we have claim. □ 



3 Existence and uniqueness of solution 

In this section we will prove that the value function is a viscosity solution of the 
HJB equation (Theorem |^SJ) and that the HJB equation admits at most one 
solution fTheorem l^.Tfl . 

We remind that we use Tis to denote the completion of Ti. in the i?-norm. 
This notation will be used in the next propositions. 

Proposition 3.1. Let u G C{T-l) be a locally B-Lipschitz function. Let tJj G 
C^{Ti.), and let x be a local maximum (or a local minimum) of u — tp. Then 
Vip{x) e 7^(Bl/2) c D{A*). 
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Proof. Wc do the proof only in the case in which a; is a local maximum (the 
other case is similar). 

We take oj G H with \uj\ = 1 and h E (0, 1). Then for every h small enough 

{u{x — huj) — 'tjj{x — huj)) u(x) — ^^{x) 
h - h 

so 

jj^x) - ^{x - huj) 
< C.\w\b 

and passing to the limit we have (VV'(a;),cj) < C|tj|B. Likewise 

{u{x + huj) — iIj{x + huj)) u{x) — ''Pix) 
h - h 

so 

iP{x) - ^j{x + huj) 
< C\w\b 

and passing to the limit we have — {\7'ip{x),Lu) < C\uj\b- 
Putting together these two remarks we have 

\{V^{x),u;)\<C\u;\b 

for all Lo E TL. So we can consider the linear extension of the continuous linear 
functional lj > {Vip{x),ui) to Tis; we will call such extension and by Riesz 
representation theorem we can find € Hb such that 

however 

where {B^/^{z^)) e H. Now for w e 7^ 

) \ =/i?V2( ) \ 

\ /(Hi5)'x(WB) \ ^ ' /n 

Therefore Vipix) = B^/'^{m^) e n{B^^'^) C D{A*) where the last inclusion 
follows from Remark 1 1.61 □ 



3.1 Existence 

In this subsection we will prove that the value function is a solution of the HJB 
equation. In the next subsection we will prove that such solution is unique. We 
start with a lemma and two propositions. We will use the notation introduced 
in Remark 11.11 on "x(s)" and "a;[r]". Moreover we will continue to use the 
symbol Sq in the text so that x[Q] = Sqx if x e D{A*). 

We have not found a simple reference for the following lemma so we prove 

it: 
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Lemma 3.2. Let x he a function of H^{0, s) then 

{x[r] — x[r — s])^ 



(i) lim 



(ii) lim 



dr = 



{x[r + s] — x[r]) 



x\r]dr 



(33) 
(34) 



Proof, part (i) 



{x[r] — x[r — s])' 



dr 



ips [r]dr 



where ips- [0, s] — > M is defined in the following way 



ifre[0,s) 



In order to prove the claim we want to apply the Lebesgue theorem. First we 
will see the a.e. convergence of the ipa to zero: for r > we take s < r: 



\x\r\ — xlr — s\ 



where dujX is the weak derivative of x {x is in for hypothesis). Now almost 
every r is a Lebesgue point and then 



Irs ^'^a;(r)d7 



|9(ja;[r]| a.e. in r ^ (0; 



while the part \x[r] — x[r — s] \ goes uniformly to 0. 

In order to dominate the convergence we note that by Morrey's theorem 
f |Eva98j Theorem 4 page 266) every x e H^{0,s) is 1/2-Holder then there 
exists a positive C such that for every s £ (0, s] and every r G [s, s] we have 



and then 



\x[r] — x[r — s] 



c[r] 



< C 



this allows to dominate ips with the constant C^, use the Lebesgue theorem and 
obtain the claim, 
part (ii): 



def 



{x[r + s] — x[r]) 



x\r]dr 



{x[r + s]x[r]) 



dr 



s-2s 



{x[r + s]x[r + s]) 



dr 



{x[r + s] ~ x[r]) 



x[r + s]dr + 



{x[r + s]x[r]) 



dr- 



s-2s 



(x[r + g])^ ^^ dg 



-his) + his) + his) (35) 
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By the continuity of x we see that: 

h{8)^X^\s] 

and 

his) — -x'm 

Moreover, using similar arguments that in (i) we find that 

hm (/(.) - /,(.)) = hm _i±±A^^^r+ 

lim ' {x[r + s] - x[r]) 



x[r\6.r = (36) 



so the limit limg^o+ l{s) exist if and only if there exist the limit limg_>o+ ^^'''^^'^'''''^^ 
and in such case they have the same value. But 

h{s)+I{s) his) + his) s^0+ X2[s]-x2[0] 



and then lim,^o+ ^"'''+i""'''" a;[r]dr) 



x^[s]-x^[0] 



□ 



Lemma 3.3. Given x G DiA*) there exists a real function 0(s) such that 
0(s) > and such that for every control (a(-),a(-)) G £ x A we have that 

\xis) -x\< 0(s) 

(where we called x{s) the trajectory that starts from x and subject to the control 
(q!(-), a(-))j. Note that 0(s) is independent of the control. 

Proof. We consider s e (0, 1]. This is an arbitrary choice but we are interested 
only in the behavior of a;(-) near to so we can assume it without problems. 
We use the explicit expression of a;(s, r): 

||a;(s) - a;||^^j,2(o_s) = 



= [ e '"'x[r-Ps]+ I e ^"^0(5 - r, r - /3r)dT - a;[r] 

J 13s Jo 

e ^''a(s - r//3) + / e ^^a(s - r, r - /3r)dT - a;[r 
Jo 

<2 \e-'''x[r-Ps]-x[r]\^dr + 2 / el"l||r 
Jbs J Bs Jo 



dr- 



dr < 



Idr 



133 



rr/13 

>l||r||+ / eW||A||d 
Jo 



T + |a;|i:,oo(o,s) 



dr+ 
2 



dr < (37) 



(We have used that x e DiA*) C W^'^iO, s) so it is continuous and |a;|io<,(o,s) < 
+00) 



< 



2j |e-''"a;[(r-/3s)A0]-a;[r]|^dr + 2s2s(^el''l||r||j + 

*/3(el^l||r|| + |xUo.+sel^l||A||)' (38) 



+ S/; 
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Observe that in this estimate the control {a{-),a{-)) does not appear. The 
second and the third terms goes to zero for s 0. In the first we can use 
Lebesgue theorem observing that 



-"'xlir - (3s) A 0] - a;[r] I < (e'^l |x| 



and that le'i^'xlir - /3s) A 0] - x[r]\ 
proven. 



ioo + a; 



V(s, r) e (0, 1] X [0, s] 



pointwise. So the statement is 

□ 



Proposition 3.4. Given x G D{A*) and g G test2 there exists a real function 

and such that for every control (a(-),a(-)) € £ x A 

9'oi\^\) 



0{s) such that 0{s) — 
with a(-) continuous we have that 

9ix{s)) - g{x) /o" (V5(x), a{r)) 



(V.g(a;),-^a;) 



< 



irip 



(where we called x{s) the trajectory that starts from x and subject to the control 
{a{-) , a[-)) ) . Note that 0{s) is independent of the control. 

Proof. First we write 

s s 
g{x{s)) - g{y{s)) + g{y{s)) - g{x) ^^^^^^ {Wg{x),a{r)) 



- (V.g(a;),-Ai2:) - 



where y{-) is the solution of 



y{s) = Ay{s) + l3Soa{s) 
y(0) = X 



(39) 



(40) 



(that is our system when ^ — and a(-) = 0). x(-) satisfies the mild equation^ 



x{s) 



e'^x 



A 



e("-")'^(a(T)i/)dT + / e^''^'^^ia{T) - fixiT))dT (41) 
Jo 

The term (e^'^a; — A e'^*~'^-''^(a(T)i/)dr) is the mild solution of y(-) and 

x{s) - y{s) = f e("-^)'^(a(r) - ^lx{T))dT. 
Jo 

Now we come back to (|39|) . we have 
9ix{s)) - g{x) (V.g(a;), a{r)) dr 



< 



S 3 

g{x{s)) ~ g{y{s)) {Wg{x),a{r)) dr 



< 



(V.g(a;),-Aix) 



9{y{s)) - 9{x) 



(42) 



^We have already written an explicit mild form of the solution in JSJ, the form we use here 
is different, indeed it is not explicit because the x appears also in the second term. The only 
difference between the two formula is the following: equation is the equation we obtain 
if we include the term —fix in the generator of the semigroup, equation 1411 is the form we 
obtain if we maintain the term —fix out of the generator of the semigroup. The two forms 
are equivalent. 
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In order to estimate the first addendum we use the Taylor expansion as follows: 



9ix{s)) - g{y{s)) _ /^^^^^^^^ x{s) - y{s) 



+ (^V5(e(s)) - V5(y(s)) 
where ^(s) is a point between x{s) and y{s) 



- y{s) 



(43) 



V5(C(s))-V<?(y(s)), 



/;e(--)^(a(r)-MT))dr' 



(44) 



We know by Lemma 13.31 that x{s) '^^"> x y(s) ''^"> x uniformly in the con- 



trol («(•), a(-)), and so \/g{y{s)) 



Vg{x) uniformly in the control and 



\Vg{y{s))~Vg{m)\ 



s^O 



uniformly in the control. Moreover, in view of 



boundedness of the control and of the fact that x{s) > x uniformly in the 
control fLemma l3.3|) we can prove that the term 

/;e(--)^(a(T)-/xa^(r))dT 



H 



is bounded uniformly in the control and s G (0, s] and we conclude that the 
second term of the ()44|l goes to zero uniformly in (a(-), a(-)) and that 



g{xis)) ~ givis)) {\7g{x),a{r)) dr 



- (V.g(a;),-A*a;) 



< 0(s) (45) 



s^O 



where 0(s) > and it does not depend on the control. 



So we have now to estimate the second term of the (|42|l , namely 



If we prove that it is smaller then ^^jj^l3^^^-^+0{s) where 0{s) does not depend 
on the control we have proven the proposition. 
We first note that 



Vg(a:) =5o(k|)i 



and 



I X (g) X 
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We consider the Taylor's expansion of g at x: 

g{y{s))-g{x) _ {Wg{x),y{s)-x) , I {y{s) - x)^ {D^g{x)){y{s) - x) 



s 

_ go(kl) f I yis)-x \ 1 {y{s)-x,y{s)~x) 
- \x\ lv\ ' W 2 

1 fgiMI _ g^\ {x,yis)-xf o{\yis)-x\^) ,g 
2\ \x\^ |x|3 J s s 

PI + P2 + P3 (46) 

First we prove that P2 and P3 go to zero uniformly in («(•), a(-)) and then we 
will estimate PI. We proceed in two steps: 

step 1: There exists a constant C such that for every admissible control a(-)) G 

£ X A with a(-) continuous and every s G (0, 1]^ 



{x,y{s) - x) 



< C 



(as before the choice of the interval (0,1] it is not essential: we are interested 
in the behavior near zero). We observe first that the explici solution of y{s)[r] 
can be found taking /i = and a in We have: 



y{s,r) 



so 



x{r — l3s) r e [/3s, s] 
a{s~r/f3) re[0,/3s) 



. ^ (x[r-Ps]-x[r]) ^ J,''x[r]{a{s-r/f])-x[r])dr 
X [r\ dr+ — 

'-^^ , ^ {x[r + l3s]~x[r]) ^ H^^^x^Mdr J^' x[r]x[r + Ps]dr ^ 

x[r\ dr H \ — h 

/3s s s s 



x[r]a{s — r/P)dr J^^'^ x'^[r]dr 



(47) 



The third and the fifth part have opposite limits, the second goes to zero thanks 
to the fact that x G D{A*) and then x is continuous and x{s) = 0. The first 
part goes to — ^a;^[0] = x) in view of Lemma 13.21 The only term in which 

the control appears is the fourth but we can estimate it as follows: 



j^'^ x[r]a{s — r//3)dr 



< ' ^ ^ < /3 max x r] T 

S re[0,s] 



step 2: There exists a constant C such that for every admissible control 
a(-) G A with a(-) continuous and every s G (0, 1] 



\y{s) - x\' 



< C 



'^In the expression of y(-) the distributed control q(-) does not appear, so we will speak 
from now only of the boundary control a( ) 
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Indeed 

(y(s) - x,y{s) - x) 



{x[r — I3s\ — x[r\y 



dr 



13s 



S^'{a{s-r/P)-x[r]fAr 



(48) 



in view of the fact that x G D{A*) C H^{0,s) and of the Lemma [3.21 the first 
part goes to zero. Moreover, since x € H{0,s) C L°°(0, s), the second part is 
less or equal to 



Cmi'dr , /,'"2|:r[r]|||r||dr , ^ \x[r]\'dr 



r0s 



+ 



< C. 



(49) 



This completes step 2. 

From step 2 it follows that 



o(|y(s) - x|2) _ o{\y{s) - xp) \y{s) - ,^o+ 



|?/(s)-a;|2 s 

uniformly in a (•). Thus |P3| uniformly in a{ ). Moreover 

{x,y{s) ~xf \ {x,y{s) - x) \ 







< 



■\A\y{s) - x\ 



and so, from step 1 and Lemma 13.31 |P2| I^^^ Q uniformly in a(-). 
step 3: Conclusion 

We now estimate PI. We can write a more explicit form of PI as in the 
proofs of step 1 and step 2 f (|47|l . (|48|l and H49|) ') and using the same arguments 

we can see that there exists a rest o(l) (depending only on x) with o(l) > 

such that for every control a(-) continuous 



PI = 



.9^,(1x1) 



x[3\a{s-r/(3)Ar 1 ^(a(.s ~ r//3))^dr 



/3s / 



s 2 

/3s 2 r 1 J 1 r/3s 
k 

2 



1 /(f' a;2[r]dr ^ 1 -2x[r]a(s ~ r//3)dr 
'2 ^ ^ 



+ o(l) (50) 



40] = 



The fourth part of the above, that does not depend on the control, goes to /?- 2 
that is the opposite of the first part. The second and the fifth part are opposite. 
So we have that 



PI = o( 

Now, using the estimates on PI, P2 and P3 we see that 

9{y{s))-g{x) 



2 \x\ 



Using this fact and equation H45|l in (|42|l we have proven the proposition. □ 
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Proposition 3.5. If x G D{A*) and <j) G testl then there exists a real function 



0{s) such that 0{s) -^^^ Q and such that for every control (a(-),a(-)) £ £ x A 
with a(-) continuous we have that 

ct>ix{s)) ^ <j>ix) /;(V0(a;),a(r))dr 



{A*V<l>ix),x) 



- (V0(a:),-/ia;) - 
j;{pSo{V^ix)),air))^dr 



<0{s) (51) 



(where we called x{s) the trajectory that starts from x and subject to the control 
{a{-) , a{-)) ) . Note that 0(s) is independent of the control. 

Proof. We proceed as in the proof of Proposition 13.41 observing that 

^ix{s)) ~ cj,{x) cj,{x{s)) ~ cf>{y{s)) , cj>{y{s)) - cj,{x) 



+ 



where y{-) is the solution of (|40(l . It is possible to prove, using exactly the same 
arguments used in the proof of Proposition 13.41 that 



<Ois) 



where 0{s) > and does not depend on the control. So we have to prove 

that 



<Ois) 



where 0{s) > and does not depend on the control. 

We write 



=Iq + Ii = ( V0(x), 



+ (V0(e(s))-V(/.(x), 



y{s) - X 



(52) 



where ^(s) is a point between x and y{s). In view of Lemma l3.3l \y{s)—x\ ''^°> 
uniformly in the control, so |f (s) — x\ > uniformly in a(-). By hypothesis 

Ti. — > D(A*) and it is continuous 

{D{A*) is endowed with the graph norm). Then 



|V</.(C(s))-V0(x)b(^.) ^0 



(53) 



uniformly in a(-). 
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If we read equation (|40|l in D{A*y it appears as an equation of the form 



iiit) - Au{t) + fit) 
u{0) = X 

where f{t) is a bounded measurable function < /^l'5o|_D(yi*)'||r||) 

and A is an extension of A that generates of a Co-semigroup on D{A*y . So'' we 
can choose a constant C that depends on x such that, for all admissible control 
a(-) continuous and all s G (0, 1], 



\y{s) - x\D{A-y 



< c 



(54) 



Thus by H53(l and l|54|l . we can say that |/i 



uniformly in a(-). Therefore 



<j>{y{s)) - <j>{x) {W(l){x),y{s)-x) 



s^O 



uniformly in a(-). We now write 



(V0(x),2/(s)-x> 



/3s S 

/g^' V<^(2:)[r](a(s - r/(3) ~ x[r])dr 



, , Vm[r + Ps]~V(b{x)[r] ^ 

x[r\ ar - 

(3s * 



<j){x)[r\x[r\ 



■dr- 



s-/3s 



+ 



/(f" (V0(x)[r + /3s]a;[r])dr /g'^" V (l){x)[r\a{s - r//3)dr 



s 



/(f'-V(/)(x)[r]x[r]dr 



(55) 



The third and the fifth terms, that do not depend on the control, have opposite 
limits, the second goes to zero because V(t){x) and x are in D{A*) and then 
x[s\ = = V(j){x)[s\. The first term goes to {A*\I 4>{x) , x) . Finally we observe 
that the only term that depends on the control is the fourth and 



V(j){x) [r]a{s - r/l3)Ar V0(a;) [0]a(s - r')dr' 



s^O 



uniformly in a(-) and, since (/)(x)[0] is a constant, 

^ /;V0(x)[O]a(s-r)dr _ {pSoVcP{x),a{r))^dr 



This complete the proof. 



□ 



We can now prove that the value function is a solution of the HJB equation 
equation. 



*In view of the fact that x is in W C D{A) C D(A*)', see |Fag02| for a proof. 
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Theorem 3.6. Let L satisfy (LI) and (L2) let T and K be a compact subsets 
ofM.. Then the value function V is bounded, B-Lipschitz and is a solution of 
the HJB equation. 

Proof. The boundedness of V follows from the boundedness of L (assumption 
(L2)). The i?-Lipschitz property is the result of Proposition 12.41 It remains to 
verify that y is a solution of the HJB equation. 
Subsolution: 

Let x be a local maximum of V — {(j) + g) for (f> e testl and g £ test2. Thanks 
to Proposition 13.11 we know that V(0 + g){x) G D{A*). Moreover we know 
that V(j){x) G D{A*) for the definition of the set testl. So 'Vg{x) = ffoda^Djfj G 
D{A*) and this implies that x € D{A*). We can assume that V{x) — {4>+g){x) = 
0. We consider the constant control (a(-),a(-)) = (a, a) G E x P and x{s) the 
trajectory starting from x and subject to (a, a). Then for s small enough 

Vix{s)) - (0 + g)ix{s)) < Vix) ~ (0 + g){x) 

and thanks to the Bellman principle of optimality we know that 

V{x) <e~P'V{x{s)) + f e-P''L{x{r),a,a)dr 
Jq 

Then 



s 

e^P^ L{x{r), a, a)dr 



< 0. (56) 



Using Proposition 13.41 and Proposition 13.51 we can now pass to the limsup as 

s — > to obtain 

pV{x) ~ (V0(a;), -fix) ~ {Wg{x),-fix) ~ 

(A*V(/)(x), x) + (/3(5o(V0(a;)), a)^ + (V0(a:), a) + {S/g{x), a)+L{x, a,a)] < 



Taking the inf (q, ^^gsxr we obtain the subsolution inequality. 
Supersolution: 

Let a; be a minimum for V + {(p + g) and such that V + {(p + g){x) = 0. As in 
the subsolution proof we obtain that x G D{A*). For e > take {a^{-),air{-)) 
an e^-optimal strategy. We can assume a(-) continuous (it is not hard to see). 
We call x{s) the trajectory starting from x and subject to {a^{-), a^{-). Now for 
s small enough 

V{x{s)) + (0 + g){x{s)) > V{x) + (0 + g){x) 
and thanks to the e^-optimality and the Bellman principle we know that 

V{,x) + £^ > e-P'V{x(s)) + / e-P''L{x(r),ae{,r),ae{r))dr 
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We take s — e. Then 

{x{e)) - (j){x) gix{e)) - g{x) 



-Vix{e)) 



£ £ 



in view of Proposition 13.41 and Proposition 13 . 51 we can choose, independently of 



the control (ae(-)i o-ei')), a o(l) with o(l) ^^°) such that: 

pV{x) + (A*V(t){x), x) + (V(/)(x) + Vg{x),-iix) - 

_ l^ /o (-/3^o(V0(x),ae(r))K + e-^'-£(:r(r),ae(r),ae(r))dr 

/,^(V0(x)+Vff(:z;),ae(r))dr \ ^ ff^(|a:|) ||rf 

£ / 2 ^ ^ 

we now take inf over a and a inside the integral and let £ ^ to obtain that 

pV{x) + {A*\'(j){x), x) + (V0(x) + Vg(x),~nx) - 
- inf [ - {(35Q{V4>{x)),a)^ + L{x,a,a)- {V4){x)+Vg{x),a)]> 

(we observe again that the fact that o(l) '^^"> uniformly in the control is 
essential). Therefore F is a solution of the HJB equation. □ 

3.2 Uniqueness 

Now we can prove a uniqueness result: we prove the result in the case /x 7^ 0. 
The case /i = is simpler and can be proven with small changes in the proof. 

Theorem 3.7. Let L satisfy (LI) and (L2) let V and A be compact subsets of 
M. Then given a supersolution v of the HJB equation and a subsolution u we 
have 

u{x) < v{x) for every x G H 
In particular there exist at most one solution of the HJB equation 

Proof. We will proceed by contradiction. Assume that u is a subsolution of the 
HJB equation and v a supersolution and suppose that there exists x € Ti. and 
7 > such that 

(w(i) - v{x)) > ^ > 
P 

We take 7 < 1. So, taken i) > small enough we have 

u{x) - v{x) - 131x1^ > — > (61) 
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We consider e > and ?/; : H x H ^ R given by 

i^ix, y) u{x) - v{y) - Ys^^^'^^x - y)\'' - ^\x\^ - ^-\y\\ 

Thanks to the boundedness of u and chosen > 0, there exist i?^ > 
such that 

V'(0,0)>( sup (V'(a;,y)) ) +1 (62) 

\(|2:|>_Rfl) or {\v\>Ri,) J 

We set 

S = {{x,y) eHxH : \x\ < R^) and \y\ < R^,} 

If we choose R^ big enough x G S. By standard techniques (see |LY95j page 
252) we can find p and q inTi. with \p\ < a and \q\ < a and such that 

(x, y) ^ i}{x, y) - {Bp, x) - {Bq, y) 

attains a maximum in S. We cah {x,y) the point of maximum. If we choose 
<7 small enough (for example such that CT||i3||i?fl < j-) we know by l|62(l that 
such maximum is in the interior of S and, thanks to (|61|l . that 

_ 37 

^(a^, y) - {Bp, x) - {Bq, y) > —. 

2p 

Moreover 

ip{x,y) > — and so u{x) — v{y) > — . (63) 
P P 

We now make some preliminary estimates that we will use in the following: 
Estimates 1 (on e): 

We observe that 

f M: [1,0) ^ M 

\ M:e^ sup(^^j^)g„>,„ {u{x) ~ v{y) - ^ \B^^^{x - y)\^^ 

is non- increasing and bounded and so it admits a limit for e — > 0^. So there 
exists a e > such that, for every < ei, £2 < £ we have that 

|M(£r)-M(£.)|<(^^^)' (64) 

We choose now e, that will be fixed in the sequel of the proof: 

1 



min <{ £, } (65) 



{Cl is the constant introduced in hypothesys (LI) and (L2)). Now we state and 
prove a claim that we will use in the following: 

Claim 
If X (z Ti. and y G Ti. satisfy 



<i) - viy) - 1 \B^^\i -y)\\ Mis) - {j^^)' 



(66) 
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then 



< 



7 



32 y{i + \fi\ 



(67) 



proof of the claim: 

(We follow the idea used in Lemma 3.2 of |('L94j ) 



M{e/2) > u{x) ~ y{y) - ^ B^/^i - y) 



u{i) ^ y{y) ~ ^^\B^'\i ~ yf 



1 

Ae 



> M{e) - 



1 



16(1 + |m|) 



B^'^{i-y) 
1 



> 



4e 



B^'^{i-y) (68) 



So 



1 

4e 



i,V.(i-j)f<M(./2,-M,.)+(^^^)' 



< 



< 



16(1 + ImI) 



7 



where the inequality M{e/2) — M{e) < 
£ H65|) that implies e < e and 

Note that from H65|l we have 



16(1 + |m|) 



= 2 



16(1 + ImI) 



(69) 



,16(l+|/i|) 

of e H65|) that implies £ < e and then the H64|l . The claim follows 



follows from the definition 



^ > aV2Cl 

and then if a;, y satisfy the hypothesis (|56|l of the claim we have 



Estimates 2 (on a): 



Cl \x-y\B < 



We have already imposed a < 4||^'||^^ , we take from now 



32(1+1^1) 



(70) 



so that 
and 



(T !■ 



aR{) > 



(71) 



(72) 



(73) 



We recall that we have already fixed e in (|65() . From the choice of a (|71|l follows 
that 

(74) 



\{Bp,x)\ < \\B\\aR^ ^ 0, \{Bq,y)\ < \\B\\aR^ ^ 



Moreover, in view of the continuity of the linear operator A*B: H — > H that 
has norm ||A*i?|L we have 



\(A*Bp,x)\<\\A*B\\aRi) ^^0, \(A*Bq,y)\ < \\B\\<7R^ (75) 
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Estimates 3 (on i)): One can prove that, fixed e we have 



(76) 



(it is a quite standard fact, see for example |('L94j \ So 
lim {ip{x,y) - {Bp,x) - {Bq,y)) = 



sup 

{x.,y)£HxH 



xix)-viy)-- B'/^ix-y) > 2^ (77) 



2e 



(where the last inequality follows from the (|61|l 'l. In H65|l we fixed £, in H71|l we 
chose (J as function of d. Now we will fix d. We begin taking 



^ < 



so that 



64/?||rp 



(78) 



We know from l|74|l and l|75|l that if we choose i) small enough we have 
\fi\\{Bp,x)\<-^, \^l\\{Bq,y)\ < ^ 



64 

\{A*Bp,x)\<^, 



\{A*Bq,y)\<^^ 



From (|76|l we know that if we choose d small enough we have 

Moreover the H76|l implies also that 
and then if we choose •& small enough we have 



(79) 



(80) 



^l|S|i(|5;| + |27|)< 



32 



(81) 



Moreover, in view of 1)77(1 we know that that if we choose d small enough, x 
and y satisfy the hypothesis (|66|) of the Claim and then, from the (|67|) . we have 



B'/^ix-y) 



< 



< 



7 



< 



7 



(82) 



32 \{l + \fi\)J - 32{l + \fi\) - 32 

(where we uses that if < a < 1 then < a, we recall that we took < 7 < 1 
From the 16 7() in the same way we obtain 



and, from lf7?Hl . 



e 



Cr 



B^'\x-y) 



B"\x-y) 



< 



32 



< 



32 



(83) 
(84) 
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Eventually, from 1)72(1 if we choose i) small enough we have 

2||B|||p|||E|| <2||i?||a||S|| < ^ (85) 

and 

2a||<5ooi?||||r|| < ^ (86) 
where we have called ||(5o ° ^11 the norm of the linear continuous functional 
We choose t9 > smah enough to satisfy GHl, (EOl, (ESI 

I 

We have finished our preliminary estimates and we come back to the main 
part of the proof of the theorem. The map 



a; I— > u 



attains a maximum at x and 

y - v{y) + [yJB^^'i^ - y)\' + f + (Bg, y) 

attains a minimum at y. 

Note that thanks to Proposition 13 . II a; and y are in D{A*). We can now use 
the definition of sub- and super-solution (page EI) to obtain that 

pu{x) - - {A*B{x -y),x)-- {B{x - y),-tix) - {A* Bp, x) - 

e e 

- {Bp,-p,x) {x,-fix) - inf (- {f3do{B{x-y)),a)^ + {(35Q{Bp),a)^ + 



and 



(c(,a)esxr \e 

+ i){x,a) + - {B{x - y), a) + {Bp, a) + L{x, a, a)] < ' \ " (87) 

2 



pv{y) - - {A*B{x -y),y)-- {B{x - y),-py) + {A*Bq, y) + 
e e 

+ {Bq,-py)+d{y,~py)- inf \- {(35q{B{x - y)),a)^~ {(35^{Bq),a)^~ 
- d {y,a) + -{B{x - y),a) ~ {Bq,a) + L{y,a,a) \ > (88) 
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Subtracting the above we obtain 

pu{x) - pv{y) - i {A*B{x - y), {x - y)) - 

- i {B{x ~ y), -fi{x - y)) - {A* Bp, x) - {A*Bq, y) - 

- {Bp, -fix) - {Bq, -fiy) - -d {x, -p,x) - {y, ~ny) - 

- inf (- {pSoiBix - y)),a)^ + {p5oiBp),a)^ + 
+ ■& {x,a) + - {B{x — y), a) + {Bp, a) + L{x, a, a)^ + 
+ , inf ^ ( - {PSoiBix - y)), a)^ - {f35oiBq), a)^ - 
-d{y,a) + ^ {B{x - y), a) - {Bq, a) + L{y, a, a)^ < 

We now note that: 

(A) : from ^ A*B <B a.nd then 

_i {A*B{x - y), [x - y)) > {B{x - y), {x - y)) ^ ~ y|| 

(B) : We have 

- inf {-{[35o{B{x-y)),a)^ + {l35a{Bp),a)^ + 
(Q,a)esxr \e 

+ tI) {x,a) + - {B(x — y), a) + {Bp, a) + L{x, a, a)^ + 

+ inf (-{l35Q{B{x~y)),a)^-{l35o{Bq),a)^- 

-d{y,a) + ^ {B{x - y), a) - {Bq, a) + L{y, a, a)^ > 

> inf [ - {(35o{Bp),a)^- {(35Q{Bq),a)„+ L{y,a,a) - L{x,a,a) 
(Q,a)esxr \^ ~ 

— "d {y,a) — d {x, a) — {Bq, a) — {Bp, a) ^ > 

> inf {L(y,a,a) — L{x,a,a) 
(a,a)eExr V 

- sup ({p5oiBp),a)^ + {pSoiBq),, 
(Q,a)esxr ^ 

— sup (iS {y,a) +-d {x, a) j — sup ( {Bq, a) + {Bp, a) j > 
> -Cl\x - y\B 2a\\So o B\\ \\T\\ + \y\) - 2\\BMn\ 
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Thus using (A) and (B) in H89|l we have 

- ^ {B{x -y),-{x-y))~ {A* Bp, x) - {A*Bq, y) - 

- {Bp, -px) ~ {Bq, ~py) - d {x, -p,x) - {y, -p.y) ~ 

-Cl\x- y\B - 2a\\6o o B||||r|| - m\^{\x\ + \y\) - 2||B||a||S|| - l3d\\r\\^ < 

(91) 

using jH2l, (IH3l, (Cnil, IHl, IMI), JHH, (CHIl we obtain 

(92) 

that is 

p{u{x) - vm - ^7 < (93) 
but from the (|63|) we have p{u{x) — w(y)) > 7 and then we obtain from the H93|) 

^7 = 7 - ^7 < p{u{x) - v{y)) - ^7 < 
that is a contradiction because 7 > and so the theorem is proven. □ 

Remark 3.8. Now we can explain a remark we have done in the introduction: 
it is difficult to treat with the same arguments the case in which p is not a 
constant but a function of r. In the proof of the uniqueness we have to estimate 
the term ^ {B{x — y), —p{x — y)) and we can estimate it because we use the term 

- \x — y'fg to penalize the doubling with respect the B-norm. If we consider 
the case in which p is a function of r such term would appear in the form 
i {B{x — y), —p,{-){x — y)) (where —(i{-){x — y) is the pointwise product of the 
L°°(0, s) function p{-) and the L'^{0, s) function {x — y). We do not know how 
to treat such term. 
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